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ES INTRODUCTION 


As we are reminded on an all too frequent basis, weapons 
systems acquisitions by the Department of Defense (DoD) have 
been plagued by a series of cost overruns. With the current 
political climate of intense scrutiny of government 
expenditures in an effort to shrink the federal budget and 
battle record deficits, the DoD can ill afford any such 
adverse publicity. Some of the implications of continued 
deficient cost estimation are particularly disturbing. 
Using pessimistic cost estimates that encompass all 
uncertainty will minimize the chance of a cost overun by 
providing cost estimates that are consistently too high. 
Of real concern is the possibility that these unnecessarily 
high estimates might become Cel rit king prephécue w 
Such cost estimates might also prompt a decision to invest 
in an alternative system that is less costly but also less 
cost effective--the end result would be an inefficient 
allocation of valuable economic resources. At the other 
extreme, a cost estimate that is too low can lead to 
insufficient funding which, if not supplemented, could delay 
deliveries of needed weapons or prematurely terminate 
production at output quantities that are less than optimal. 


Another effect, with possibly more serious consequences, is 


the possible erosion of public trust in our military forces 
if the public perceives mismanagement and waste are 
perceived to be the source of cost overruns. 

Some of our cost estimation difficulties stem from 
design changes or improvements that occur after a cost 
analyst has formulated an estimate of a program's cost. 
Such problems are beyond the analyst's control? 
unfortunately, cost estimation problems have occurred in 
many programs that didn't experience such changes. A 
possible conclusion is that our current cost estimation 
methodology is inadequate and that a better understanding of 
the factors that determine cost is required. 

Current methods of cost estimation can be divided into 
two approaches: Mene. topdown" or Statistical approach 
which generates simple, imprecise estimates based on 
existing similar systems and which is insensitive to many 
PeodLEFIONNAECI=ITons and (2) the “bottom up” or industrial 
engineering approach which examines 7:5 segments of 
vork in great detail and synthesizes these estimates into a 
complex, yet often imprecise, total cost estimate vhich 
requires substantial revision vhen changes occur. Neither 
of these approaches is particularly helpful to a program 
manager who must develop a funding profile suitable for 
projected lot release dates and delivery schedules and then 
deal with subsequent changes in funding or production 


schedule. 


This paper concentrates on a model developed principally 
by Gulledge and Womer [Ref. 1] that strives to model the 
factors influencing the cost of airframe production. In 
particular, the influences of production rate and delivery 
schedule, as well as the standard learning effects, are 
thought to significanti marr ect program Costa: These 
factors, together with basic economic theory, are 
incorporated into a model which aspires to encourage wiser 
acquisition policy by providing greater sensitivity to 
alternative policy decisions. The chapters that follow will 
provide a historical perspective of cost estimation 
methodology, review the proposed model, evaluate its 
performance using data on F-4B airframes purchased by the 


Navy, and investigate the model's applications. 


Me HISTORICAL PERSPECTIVE 


The DoD has historically favored a relatively simple 
parametric approach to cost estimation. Costs are modeled 
as a function of only a few aircraft design and performance 
characteristics and unit costs are expected to decrease as 
learning accumulates with production experience. The model 
considered in this paper is unique in that it attempts to 
model the effects of production rates as well as learning 
5:1777 1np111  the effects of facility size on total 
program costs. Ea it is an integration mof what have 
generally been two distinct approaches to cost estimation: 
(1) the neoclassical economic approach which purports 
production rate to be a significant determinant of cost and 
(2) engineering cost studies which rely heavily on the 
learning curve to relate costs to the number of items 
produced but not to the rate at which they are produced. 

Economic theory typically depicts the relationship 
between unit production costs and output per production 
period as a U-shaped function. Such a shape indicates that, 
as the level of output increases, unit costs fall over a 
certain range and then begin to rise. This reflects the 
powerful logic of the law of diminishing returns which, as 


explained by Samuelson (Ref. 2], says 


An increase in some inputs relative to other fixed inputs 
will, in a given state of technology, cause total output 
to increase; but after a point the extra output resulting 
from the same additions of ra inputs is likely to 
become less and less. This falling off of extra returns 
is a consequence of the fact that new "doses" of the 
varying resources have less and less of the fixed 
resources to work with. 
Johnston [Ref. 3] cites the concept of diminishing marginal 
product as one of the most common generalizations of the law 
of diminishing returns. Diminishing marginal product refers 
to the eventual decreaSing increments in output that occur 
when the quantity of an input is increased by equal 
increments, with all other input quantities remaining fixed. 
A tendency for varying factors to show diminishing returns 
when applied to fixed factors implies a tendency for 
marginal cost to be rising. If at first there are 
increasing returns, there are also declining marginal 
costs--but ultimately diminishing returns and increasing 
marginal cost will prevail. Such a formulation is consis- 
tent with the notion that, for a firm operating in perfectly 
competitive product and factor markets, marginal cost at 
equilibrium must be rising. 

The implication of diminishing returns for an airframe 
cost model is reasonably clear. An increase in production 
rate will, at least in the short term, require additional 
labor. Since the production facility itself nos 35. 


considered fixed, consider two alternatives proposed by 


Washburn [Ref. 4] that could be used to increase the 


l0 


produet iont ate: (1) overtime or weekend work where a 
premium iS paid for labor at odd hours; or (2) hiring 
additional manpower at a loss of efficiency due to crowding, 
seheduling, etc. Economic theory thus leads us to the 
ECHEKUSTON that production rate and production costs are 
positively related; that is, with higher production rates, 
labor is more costly and/or less efficient, and, as a 
consequence, costs per unit of output increase. while 
firmly grounded in economic theory, this conclusion has 
suffered from a lack of empirical verification. 

In contrast to the neoclassical approach is the 
engineering cost study technique which incorporates the 
progress function or learning curve concept developed by 
perjht [Ref Jm5]. In his pioneering analysis of aircraft 
production costs, Wright noted that labor hours per unit of 
output decreased as cumulative output increased and proposed 
the function F = N* (u85 05 5 0 cost (variation 
proportional to N, the quantity produced, X is a learning 
parameter) to explain the labor cost-production quantity 
relationshiPRN"WrighE"s data were eonsistent with the eighty 
percent learning curve which has received widespread 
acceptance a5 an industry "standard". As explained by 
Wright, greater production improves worker efficiency and 
makes additional tooling economically feasible so that a 


Enca only an eighty percent increase in labor costs 
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when output is doubled. It should be noted that Wright's 
research and the factors derived assumed that no major 
changes would be introduced during production. 

It is readily apparent that production rate and pro- 
duction quantity are positively correlated so it seems that 
these two approaches to cost estimation are contradictory. 
The first hypothesizes that Minit product ion r costs e 
directly related to the rate of production while the second 
hypothesizes that unit production costs are "inversely 
related to the cumulative volume of production which, in 
turn, is directly related tothe rate of produc SE 
Further complicating the puzzle is that the first approach 
is based on solid, well-accepted economic theory with little 
empirical support while the other is seemingly adopted to 
explain the data and has little theoretical ünderpinnings. 

Numerous research efforts have been undertaken to 
investigate the ambiguity of the cost/quantity/rate 
relationship: In Asher's [Ref. 6] study of cost-quantity 
relationships in airframe production, he concluded that the 
conventional learning curve may not be an entirely accurate 
description of the relationship between unit cost and 
cumulative output. For certain values of cumulative output, 
he found that the labor cost curve became convex which would 
be consistent with the diminishing returns expected by the 


economist's approach. 
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In subsequent research, Alchian [Ref. 7] reformulated 
m rd ií Ono cost function to explain much of this 
apparent contradiction. While acknowledging that all of the 
Euracteristics “ÖZ a production operation can” affect its 
Göst, Alchian directs attention to x(t)--the rate of output, 
V--the total contemplated volume of output, T--the first 
scheduled delivery date, and m--the time interval between 
the first and last scheduled deliveries. These four 
characteristics comprise the input variables for the Alchian 
:75— “Zunction,70 - f(V,x;T,m). On this function are based 
Alchian's nine propositions to explain the cost-quantity 
relationship. mir other = tactors being fixed, Alchian 
contends that: EE 570, coste varies directly with 
preductionwrate; (2) 3 ^C/3x* 7:70) Thefimerement in cost is 
nı 1norcasınq” Ct on of production rate; (3) 3C/3V > 0, 
Gost varies directly with the total anticipated volume of 
SUCDUT,. 157 ə ”c/əv” < 0, the increment in cost is a decreas- 
SH FUN EU total “volume; (5) 3(C/V)79V « O, cost per 
unit decreases as total volume increases; (6) a “v/avax wO, 
marginal discounted cost of increased quantity of output 
decreases HOANG ElOnN rate increases: (7) 3C/2T < O, cost 
varies inversely with the elapsed time until first delivery, 
(8) all derivatives in propositions 1-5 are diminishing 
functions of T, but not all diminish at the same rate, and 


(9) the cost of future output declines as the total quantity 


SG 


produced increases. Propositions l 2, ^a: ирси ии 
encompass the notion of diminishing returns put forth by the 
conventional economic approach ile propoz item 4 O 
support the learning curve notion of decreasing unit costs 
as total volume increases. Even without the learning 
effect, Alchian felt that 3C/93V would be decreasing. This 
second type of cost saving depends on scheduling larger 
volumes of production in advance which may allow a reduction 
in capital cost or operating 77 IE. 

As further explained by Hirshleifer [Ref. 8], the key 
idea is that cost can be regarded as a function of the 
quantity of output in two different dimensions: the rate of 
output and the scheduled volume of output. The- first- 0f 
these is a flow measure while the second is a stock measure 
and, as pointed out by Alchian [Ref. 7], the response of 
cost to changes in the one direction is qualitatively 
different from the response to changes in the other 
dimension of output. Thus, marginal cost can always be a 
rising function of the Fate oFfeutput, volume held con cn 
and a falling function of output volume, rate being held 
constant, and neither of the aforementioned theories of cost 
estimation is contradicted. 

in their research of Alchian's proposals, Preston and 
Keachie [Ref. 9] contrasted the U or L-shaped curve 
typically used in economic analysis to depict the unit cost- 


production rate relationship with the hyperbolic learning 
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curve that models unit costs as a continuously decreasing 
Function Of total output. The learning curve approach was 
discredited for ignoring the effects of production rate. 
They felt the production rate could not be assumed constant 
nor could it be considered an immaterial factor of unit 
costs. Their suggested integration of the economist's cost 
function and the learning curve involves three variables: 


ә the level of production costs for a production period; 


t” 
qt the amount of output per production period; and V, the 
accumulated level of output. Their cost function can be 


displayed graphically as 





Figure l. Integrated Cost Function 


ES 


The U-shaped curve shows the combined effects of the 
spreading of fixed costs and the gradual rising rate of 
variable costs, while the downward slope with respect to V 
shows the learning effect. 

Using a similar approach, Cox and Gansler [Ref. 10] 
noted that a move from a relatively inefficient g, to one 
near the optimum results in more rapid cost decreases than 
would have resulted from a standard cost improvement curve. 
Conversely, a move from an efficient q, near the Optimum "EE 
a less efficient rate some distance from the optimum results 
in a reduced rate of cost improvement from what we would 
expect from a standard cost improvement curve. A cost 
increase could, and would, result if the new production rate 
is significantly different from the previous, more efficient 
rate. š 

As is becoming apparent, the interrelationship of 
production rate and the total volume of output is quite 
complicated and difficult to unravel.  Alchian's postulates 
are theoretically sound but empirically unvalidated due to 
the nature of cost data and the complexity of the rela- 
tionship. For example, when both volume and rate of output 
change in the same direction, Alchian's postulates are 
inconclusive--the two expected effects work in opposite 
directions and the net result cannot be reliably predicted. 


It has also been shown that both the magnitude and direction 


1:67 


of change in unit cost depend upon the extent of movement 
toward or away from the optimal production rate when a rate 
change-is required. 

Considering the intricacy of this cost-quantity-rate 
relationship, it is not surprising that several studies have 
found contradictory results. Large et. al. [Ref. 11] were 
forced to conclude that the influence of production rate 
could not be predicted with confidence and could probably be 
ignored since other uncertainties prevailed. Their analysis 
found that rate effects were often negligible and sometimes 
sentrary tonte priori motion that production rate and 
unit costs were inversely related. They also noted that 
high volume, high production rate programs were not typical 
of recent DoD aircraft procurements--of the 29 acquisition 
programs they surveyed, 18 had production runs of less than 
500 and only eight had production runs of greater than 1000. 
This provides empr ea evidence that production facilities 
are typically not built to sustain high production rates and 
lends credence to Washburn's previously cited contention 
that raising the production rate requires hiring additional 
labor at a premium since the production facility itself is 
fixed. 

Research by Smith [Ref. 12] and later by Congleton and 
Kinton eo used the cost function 


B 


B 
_ 1 2 


) 


where B = Cost OF first tune 


X) = cumulative quantity produced 
Bi = slope of quantity/cost curve 
Xə z rate of production 

8 = slope of rate/cost curve 


and found unit costs to be significantly and negatively 
correlated with production rates Bemis [Ref. 14] obtained 
similar results with his model for examining the effects of 
production rate on the cost of many defense items. Cox and 
Gansler's [Ref. 10] study of tactical missile programs found 
both positive and negative correlation of unit costs with 
production rate. 

Womer (Ref. 15] postulates that analyses such as these 
that conclude that unit costs decrease as the rate of 
production increases (i.e., increasing returns to scale) are 
inconsistent with or ignore optimal contractor behavior. As 
noted by Washburn [Ref. 4], consistently increasing or even 
proportional returns to scale would, in the presence of 
discounting, lead to an optimal production program that 
crowds all production into an arbitrarily short period at 
the very end. 

In a model which predates the one considered in this 
thesis, Womer [Ref. 15] incorporates the research of both 
Alchian [Ref. 7] and Washburn [Ref. 4] into a production 


function that relates the rate of resource use and 
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cumulative production experience to the output rate while 
Demann consistent with logical contractor behavior. The 


sollowng- progductaem- function is specified: 
6 n 
git) = AQ (t)x A (10592) 


vhere qura up rate at t 


Ot) - cunlübarive ovtput at t 

x(t) = rate of variable resource use at t 
ó = learning parameter; 0 < 6 < 1 

Y - weturns to scale parameter; y > 1 
A = a constant, A > 0 


By restricting y to values greater than one, it is assumed 
that diminishing returns exist for the variable resource 
which insures that the model makes economic sense. re 1S 
this key assumption that distinguishes Womer's model from 
most others. Solvimg this production function for x(t) and 
integrating over time yields the amount of the variable 
resource used daring the time period in question. This 
quantity is used as the dependent variable in the model 
formulated by Gulledge and Womer [Ref. 1]. Deae cc chis 
model, which seeks to combine the economist's theories on 
550065 effects with the learning effects ol 


cumulative production, that the remainder of this paper is 


devoted to. 


o 


LIIT. “T5 MODEL 


The model considered in this thesis was developed by 
Gulledge and Womer [Ref. l] in an effort to provide a 
sensible explanation of the joint effects of learning and 
production rate on airframe production costs. It was their 
perception that existing models were extremely limited by an 
inability to consider production policy changes which often 
occur prior to or during the course of a production program. 
Such static models could be of only limited use to a program 
manager forced to contend with changes in funding and/or 
production schedules. The thrust of their research was 
therefore to provide a model capable of capturing the rela- 
tionship between total program cost and both endogenous and 
exogenous production rate changes that inevitably occur in 
the course of a production period. Much of the ensuing 
description and derivation of the model is extracted from 
Gulledge and Womer's [Ref. 16] explanation of their revised 
model. 

Womer and Gulledge identified four means by which 
production scheduling might affect production efficiency 
and, therefore, cost. The first production cost driver is 
the usual concept of learning by doing. To help explain 


this effect and the production cost drivers, Washburn's 
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Er l GoncepE 67 a production line is incorporated as a 
frame of reference. Learning by doing affects costs by 
atrecting  Wuesmwefieiency of each position along the 
production lines That is, as the cumulative number of 
airframes passing each position increases, experience and 
efficiency at the position increase and unit costs (or at 
least labor hours) will decrease. This process implies that 
at any point in time the experience on the production line 
solid Vary significantly, 

The second production cost driver is a different 
learning effect. With the passage of time, learning may 
occur as a result of events other than experience at a 
position 0n the production line. For example, labor hours 
may be devoted specifically to improving or refining the 
technique of a particular work station in the early stages 
f a prodction program. Later in the program, this may 
result in increased efficiency independent of experience at 
a given point on the line. Positions at the end of the line 
may work more efficiently on the same airframe than 
positions at the beginning of the line. This effect might 
akso ar ion experiemncewat other locations on the 
production line. In this case, “positions: late Anw the 
production line benefit from the experience of earlier 
positions and work at these later positions is accomplished 


more efficiently. 


zı 


A third production cost driver is the Speed of e 
production Pine: Unless compensated by learning, an 
increase in the speed of the line is expected to require 
more labor at each position on the line. Due to the 
presence of diminishing returns, such increases in labor are 
expected to be more than proportional to the increase in 
speed. 

The fourth cost driver is the length of the production 
line. One means of boosting the delivery rate is to 
increase the number of positions along the production line. 
This reduces the workload per position and increases the 
total amount of work done per unit of time. If alternative 
length production lines were allowed at the start of pro- 
duction, this driver may not affect unit costs. However, if 
the length of the line is changed on short notice, unit 
costs can be adversely affected by crowded facilities and 
overused tools that hamper production efficiency. 

By augmenting a classical homogeneous production 
function with a learning hypothesis, the model now to be 
described attempts to capture the above four effects in an 
estimable and analytic manner. By minimizing the discounted 
cost of production subject to a Production fun mom 
constraint, the model"s outpiuk is the optimal time m 
resource use. Since relative factor prices are assumed 


constant over the relevant time period, costs are measured 
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Its tos labor the variable resource. Variables used in 


the analysis are: 


i 


V 

tsi 
EE 
q; (t) 
Q; (t) 
250c) 
Š 

€ 

Y 

a 

V 

p 

E 


The 


the sequence number of an airframe, i = 1,2,...,n 
the average number of airframes in process 

the date work begins on airframe i; work on all 
airframes from the same lot is assumed to start on 
the lot release date. 

the delivery date for airframe i 


the production rate at time t on airframe i 


the cumulative work performed on airframe i at 
Elme 2 ul. € ə, 


t 


Q; (t) = Í q(1) dr 


5 
SA 


RNERCOrEWGSGRLrcSORKEce Use at time t on airframe 1 


a parameter describing learning prior to 
alrframe i 


a parameter describing learning on airframe i 


a parameter describing returns to the variable 
resources 


a parameter associated with decreases in 
productivity as an airframe nears completion 


a parameter describing returns to the length of 
the production line 


the discount rate 


discounted variable cost of a single airframe 


production function is assumed to be of the 


following form: 


q; (t) 


SNE ee ZAB ии ND 
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where A is a constant. The input x is assumed to be a 
composite of many inputs whose rate is variable throughout 
the production period. 

This production function is a relatively simple function 
based upon the four previously mentioned production cost 
drivers which are combined so as to conform with economic 
theory and the empirically observed learning phenomenon. 
When analyzing each term of the function individually, the 
term (i - 1/2)? describes learning by doing in the produc- 
tion of the ith airframe. The terms adası and (ta; - ty” 
attempt to describe the effects of learning over time. pst: 
should be noted that as the delivery date is approached, it 
is assumed that labor becomes more difficult to substitute 
for time in the productive process so it is anticipated that 
both € and 4 will be between 0 and l. The term x, ET 
captures the effect of production rate with Y expected to be 
greater than l and thus consistent with diminishing returns 
to the variable resource. Finally, the term a attempts to 
capture the effect of the length of the production line. It 
is assumed that more airframes in the same facility lessens 
efficiency so that v should be negative and small. 

Assuming a contract written to induce a firm to minimize 
its discounted costs of production, the problem may be 


stated as: 
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n t 


di 
DEEM zern aS >` Í x, (t) e D "ar (32) 
i=] t 
si 


Subject to: 


UE. 6 


2) Q;(tga;) = 1 


ee i 


A 0 


Since the total cost of production is monotone nondecreasing 
and the subproblems are additive, the solution can be 
obtained by minimizing each of the subproblems. The 
representative problem for the ith airframe may thus be 


Stated as: 


t 
di Em. 
Minimize C; = J x. (t)e Pat (2.3) 
E 


si 


subject tos 


185 5702000 AO TY 


0000056 0 


Sl 


The solution procedure is initiated by absorbing the 


Constraints into the objective function. Solving the first 


25 


constraint for x.(t) yields the following resource 


requirement function: 


= M AWCE -Yn -EY Say VY 
x; (t) .—. (tA MUI 172) Q; (t) (ta; E V 
(3.4) 
After substituting into (3.3), the objective  EURGNNEM 


becomes 


je 


di 
: a Y -Y ,: –буд -€Y -a Y, -Vy -pt 
Min C; = J (4, (t)A (1-1/2) О, (E) (taat) V E 


Jdt 


-. (зы 


To simplify the solution procedure, a transformation that 
yields one state variable and one control variable is used 
with the control variable being the time rate of change of 
the state variable. Let Ë 

-1 


(1 1/2) W 00H E (50/04 (3.6) 


Z(t) =A : 


Thas implies menace 


N 2 = 

Alt) a ເ? GAR 

Thus, Z(t) is the new state variable and Sz), i p os 
derivatiwe, is the control variable. Substituting minto 


(3.4), we have an expression in terms of the new control 


variable, i.e., 
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%. (ໄ) = Sheet 57 (3.8) 


When substituted into (3.5), this yields the following 


transformed problem: 


Es. t 
1 di _ m dı 
Minimize C; - f iz . . ore cc jdt: f າ... 
tsi tsi 


SUD ect to: 


1) 2(0) = О 


-1 


2) ZI -p EP, vL ss. e) 


Са: 


ice VEne Mintermediaté "function, 1, does not depend 


explicity upon the state variable, the Euler equation is 


~ 


A l m... a 
227 YZ (t) (tai _ t) ° = K . 150) 
Solving "fem optimal z(t) yields 


J = ¿y 19/ (1-1) ¿0t/ (1-1) „ 157 


7155510 7 PP into (3.8) yields a solution to the 
optimal time path of resource use: 
¿y 9Y/ (v-1) gro t/ (v-1) 55007) 


mE Kore 


il di 
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This solution is only of transient interest sIn io Jc 
of constant Kj is unknown. An optimal expression for x(t) 
in terms of the variables and parameters of the original 
problem is needed. To determine the constant of 


integration, notice that 


t 
Z(t) = 1 K) (ta: - ຫຂ ANG Lia 5: 
t 


2 
ə (ən 


As this is not an easy integral to evaluate, another trans- 


formation is useful to simplify the solution. Let 
w = pft - Chiffre . | IN 1)/p and 
T = tai - V(y - 1)/p. The Jacobian of the transformation is 
Ј = dr/dw = -(y - 1)/o. Substituting into (3.13), we have 


ya/(y-l)  [pt.;-w(y-1)]/(y-1) 

"oz İP. sx ə ER 2755 
10/01) — su. / (y PË 
d ki MOTO pen iii e Waw 
(>. REX 
(ra/(y-1))+1 pt,:/(Y-1) 
Есик y LU e - and ve have 

7 = [erm e "av (3.16) 
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Now, the limits of integration must be determined. 


When t = t, w = p ta: - t)/(Y - 1); when T = Ed 
W= p (ta; - Een “~ t now follows that 
p (ty; t) 
M 
Z = A e "dw 2815 
p (tąi tsi) 
(Y-1) 
IR 257555 
(Y-1) (y-1) 
= J AE _ 5 — 
0 0 (3.18) 


These last two expressions can be recognized as incomplete 
gamma functions; the one on the right is always constant 


since t does not appear as a variable. We now have 


o E E FI, (vye/ly - 1))o+.1) 
=r A 1) ) +... Ka (SIE) 
where u = о (Ед: e UE) (y. 10): From the constraints for 


equation (3.9), we know that Z(0) = 0. It thus follows that 


Ka = 0 so it can be removed from (3.19). Also let 


2) 


-K, - A7" (i - 172) o tt A A 


(yo/(y - 1)) + 1] (3.20) 


so that Z also satisEles theme eondition: 





T = ATL(i - WZORY (CE) 70 JE) 
Also note that 
ҹ̧а/(у-1) 
- ey BI Sa Һм. ә 
dt y ven 


After substituting for CY the following expression is 


Obıcoıned” 


TT 


Y Y(d-e) 76 left iot 7 Or- 1) Gre Or 9E] 


z(t) = ATL(i-1/2)7 


E 
p (ty; - o UMP ; -9(tą;-t) /(Y-1) 


"=D Ë Y -1 





[ ) (3.22) 


This formulation for optimum 206) together with 08 


provides a direct solution for Kj: 


Š |= 


Ky = A A EE [p (Ego Lea (AN 


jJ 


(YyeZ(Yy=-1))+1 SrE NO 
< e (3523) 
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su (itution for K, in (3.12) yields the following optimum 


sine pach Of resource use: 


ເ. (ໄ) = B(i - WGA TE 


SAMICE MGM uc Mu 


-ye(t,.-t)/(y-l) 
577077 E ci (3.24) 


where 


2 
B = Ae a ri] (ay /(y-1))+y 


This is the optimal time path of resource use on any 
airframe. 

Since airframe manufacturing data is generally recorded 
on a monthly or quarterly basis, the quantity of interest is 
the total resource used over the appropriate period. The 
data available for this study are direct labor hours per 


month so, letting T, and T„ represent the beginning and 


ending. dates for a monthly period, the appropriate 


expression for airframe i is: 


NG 
TN / MSIE (3.25) 


Ya 


31 


Substituting for x; (t) using equation (3.12), the integral 


becomes 
12 
B Y ay/ (Y=1) We MOS) 
x, (Ta) EM J Ки е dt 
Ng 


(32526) 


Let y = Vá T OT ETE NN then y(v-1)/xY» CE anim) and t = 


tai T y (111/10. Thus when y = P MAN MM 


and when t = T}, y = Yo (tg¡¿-T,)/(Y-1). It now follows that: 


YO (tai 
(Y-1) K Q 
3 PASAN 
2 Y v s, YP 
X. (T.) Ski J K; [ ] 


ay/(y-1) yrplt,: 
= ə. Ja v 


YP 


yp (ty; -73) 
1 557) 


where J = dt/dy = -(Y-1)/Yo. 


This can be further simplified: 


ye (tai T2) 


en 
AP ar (1-1) a e ວນທ 


3 = -к1 (2=1 R 


e M 


YO (tq4-T4) 


= (3.28) 


_ ә | 3 e Yay (50 
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Cay 7 (y=-1)) +l yo EN / (y-1) 
where D = K, | (X23) e qi 
YO 
o 
(y-1) 
" a 1 8 
Xi (T4) -Xi (T1) - >| / y e Yay - 
0 
YP (tai T) 
(y-1) 
| mli Ya] 
0 


(3.30) 


In this form, the incomplete gamma function is again 


recognizable and we have 


1551 
UZ) FEB o TI Tico) ” O LIEU 


Yo(ta;-T) 
-rT [ — — 5000: u 
Y 


(5) 
Reversing the order of the last tvo terms ve have 
Z TOM A = D mn 0” бә + 1] -— 
yot =) 
[=Y , (sY/(y-1)) + 1] 
(32.32) 
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Substituting for D and fellas 


1 


ик (31) = A c) ` 


r [o(tgs=t,)/(v-1),(ve/(v-1))+1] 


raze prezan-an ann DY fai? Ə 


(ay/(y-1)) +1 Yetai/ (v-1) 
((Y-1)/Yo) = (3.33) 


This can be simplified to 
A : —YÖ,,-YV —Y 
YO YÈ B (EM V (T4 ,T4)T  [o(ta;-t4;)/(v-1) ,871 


Ye Cer 0) YP (tg; -79) 


y-1l , g J E r [ , 81) (5) 


- 


PPI Y-1 


where 80 = 25071 _ e) ASS 


(./ຕ ນາໄ“. ໃ... 
and By = (ya/(y-l)) + 1. This equation quantifies the 
amount of the variable resource required per month in the 
production of airfrane me Note that this expression is 
consistent with the assumptions made concerning the 
production. cost. drivers! This resource requirement 
equation, together with the anticipated range of values for 


each parameter (y 2 1, Ü X41 ии се | О тк ии 


v € 0), depicts resource usage per month on each airframe to 
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be indirectly related to the airframe sequence number and 
the dates when work was started and completed on the 
alrframe (representative of the effects of learning) and 
Endirectiy related to the number of airframes under con- 
struction during the time period (representative of the 
erfrects of oprodusimon- rate). 

Because of the nature of the data, it is impossible to 
observe the monthly amounts of resources devoted to any 
particular airframe. Ас creportedsiineane”datba set, what 1s 
observable is direct man-hours per job order per month. 


This means that the observed quantity is 


L L 


9 J 
S : -Yô -YV 
PW ana læ (1,19) 
1=F; Dos s 
E 15:17 AGE" o) 
E * [o (£gi-t54)/ (Y-1) 684] (1 [aq 187] = ແ... , 5 


6575 


vhere Еј апа L- 


last airframes in Job Order J. 


are the sequence numbers of the first and 


This functional form represents the aggregate of 
resource usage per month in the production of all airframes 
in Job Order J and facilitates the generation of a time path 
of resource use. Using monthly labor hours and airframe 


delivery dates as the veriables in the equation, nonlinear 
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regression using Marquardt's compromise [Ref. 17] is used to 
generate estimates for the parameters of equation (3.35). 
When equation (3.35) has been fully parameterized with these 
estimates, substitution of job order release and delivery 
dates and airframe sequence numbers allows prediction of 
monthly labor hour requirements. The following chapters are 
devoted to reporting the empirical results of the model and 


assessing how well it explains the data. 
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IV. THE DATA 


Poced On Doti its availability and suitability for 
evaluating the model's potential as a tool for a program 
manager, cost data for the F-4 Phantom II was used in this 
analysis. The F-4 was designed and built by the McDonnell 
Aircraft Company of St. Louis, Missouri in response to the 
Navy's requirements for a carrier-based aircraft capable of 
fleet air defense. First flown in May, 1958, the F-4 became 
the first Mach 2-plus carrier-based fighter by incorporating 
numerous advanced designs and technologies. So impressive 
was its performance that later versions of the F-4 were 
purchased by both the U.S. Air Force and Marine Corps as 
well as over ten foreign air forces. sn" total, thirteen 
versions of the F-4 were produced with more than 4000 
aircraft delivered between 1958 and 1979. 

Of immediate concern with such an extensive and 
heterogeneous data base are the interrelationships between 
different versions of the aircraft. lo particular ne 
extent of learning and the effects on the production rate 
parameter are somewhat obscured by having multiple versions 
of the aircraft under simultaneous production. While not 
discounting this potential problem, the necessity for 


resolving it is relieved by evaluating the model's 
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usefulness from the perspective of a Navy program manager 
who quite possibly could encounter this same problem in his 
use of- the model. One possible scenario would be where a 
program manager has cost data on an early version of an 
airframe purchased by the Navy and must develop a funding 
profile for buying an improved version based on the lot 
release and delivery dates specified in the manufacturer's 
production PM contración As it would not be unusual for the 
early version or the improved version or both to be produced 
concurrently with other contracts, it would be useful to 
know the model's usefulness in this situation. 

The F-4 program provides a particularly well suited data 
base for accomplishing the proposed objective. The Navy 
purchased two versions of the F-4, the F-4B and the F-4J. 
In all, 660 F-4B airframes were accepted bétween February, 
1958 and January, 1967 and 552 F-4J airframes were accepted 
between October, 1964 and December, 1971. The F-4B cost 
data will be used as the data base for estimating the 
model's parameters. These data were drawn from two sources. 
Direct man hours per month for each job order of F-4 
production are reported in the McDonnell Aircraft Company's 
document "Report 7290, F-4 Cost“Bata" “Ref. 18]. Air Ы ис 
acceptance dates were obtained from the OASD publication 
"Acceptance Rates and Tooling Capacity for Selected Military 


Aircraft" [Ref. 19] and used in lieu of delivery dates which 


were not available. Since the exact acceptance dates were 
unavailable, for purposes of research, airframe acceptances 
were assumed to be distributed uniformly over the month of 
acceptance, 

Several problems were encountered in compiling the data 
to use with the model. The first job order of the F-4B 
production run accumulated in excess of 172,000 labor hours 
before its reported release date. These labor hours were 
reported as a lump-sum which cannot be satisfactorily 
explained. As a result, these labor hours were not used in 
the model; the data which were used begin with the month 
thet this first job order was released for production. 

Each job order also had a small number of manhours 
expended in months after all the airframes within that job 
order had been accepted. These hours were aggregated and 
then distributed evenly throughout the preceding months of 
the job order. 

With these adjustments, 233 observations of labor hours 
recorded over 108 months in the production of 660 airframes 
remeined. These observations, together with the average 
number @f airframes under production per month, form the 


data for study as reported in the appendix. 
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V. | EMPIRICAL RESULTS 


As formulated in Chapter III, the proposed model is that 


manhours per job order per month are equal to 


L; Ly | 
EIA APAT 
1=Еј 1=F , 
MN GET.) vo CET 
P7Y [o (£a47t,,) / (71) 8 ] (r I—— p 8) - PIS 981) 


The regression estimates of the model's parameters are 


presented in Table I. 


TABLE I 


PARAMETER ESTIMATES 


Parameter Estimate Standard Error 
Pa 29003 0.665 
81 345 0577705 
ö 0.462 0.024 
Y 17006 ora 
V -0.200 0. 067 
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All parameter estimates are significantly different from 
Zero and consistent with apriori assumptions. As one of the 
model's key assumptions is the existence of an inverse 
relationship between production rate and unit costs, 
attention is first directed to the estimated value for Y. 
The estimated value of 1.006 indicates the existence of 
decreasing returns to labor inputs. That is, increases in 
the rate of production will increase labor requirements (and 
Memee unit costs). The estimated value of $ corresponds to 
a 73 per cent learning curve. While this percentage may be 
PMiently lóowaby industry standards, it is not all that 
sirorising due to the concurrent production of other models 
of the F-4. Some learning in the production of these other 
models undoubtedly benefited the F-4B program and 
contributed to the observed 73 per cent learning curve. The 
small negative value for v confirms expectetions about the 
—55cts 017 tacility size and crowding. a is a scaling 
parameter and appeers consistent with earlier studies. The 
estimated values of 81 implies a and e values of 0.01 which, 
while small, are within the range of apriori assumptions. 
Graphical analysis demonstrates the time path of 
resource use generated by the model to be a reasonable one. 
Figure 2 illustrates the time path of labor use predicted by 
the model and the actual labor hours used. Figure 2” 


compares a 90 per cent confidence interval for the predicted 
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labor hours with the observed labor hours. The model does 
fit the data quite well as evidenced by the R” value of .76 
obtained by squaring the XY correlation coefficient reported 
in Figure 4. This figure shows that plotting the observed 
values against the predicted values yields approximately a 
45 degree line which further illustrates the model's success 
in explaining the variability of the data. Relatively large 
and unexplained deviations between the observed and 
predicted values are apparent during roughly the first and 
last thirds of the production run (approximately months 
19-31 and 69-96). Disassembling Figure 2 into individual 
job orders (Figures 5-13) reveals that most of the deviation 
noted during the first third of the production run can De 
attributed to Job Order» This job order is charac- 
terized by the predicted time path lagging several months 
behind the observed. A factor of unknown significance is 
that this was the first sizable job order to be released. 
The second area of deviation corresponds with a very large 
release of another model of the F-4 which may have had 
unpredictable effects on the regression output. 

Analysis of the residuals shows them to be essentially 
normal with no extreme outliers noticeable. Residual 
analysis was conducted on two levels--the 233 observations 
available before aggregating the nine job orders and the 108 


observations formed by combining the job orders into the 
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time path shown in Figure 2. Figures 14-18 depict the 
larger set of residuals. These residuals generally appear 
random.and symmetric with a sample mean of 0.002 and some 
positive skewness evident. When plotted against the 
dependent variable, the sign and magnitude of the residuals 
do exhibit a slight positive relationship with the observed 
amount of labor hours. The statistical table of Figure 18 
contains several goodness of fit statistics which generally 
do not contradict, at a .05 significance level, a hypothesis 
of normally “distributed residuals. To test for 
heteroskedasticity, the residuals were divided in half and a 
hypothesis of ecual variances was tested using an F test 
(See Mood, Graybill, and Boes [Ref. 20]). An F statistic of 
1.19 (associated significance level = 0.34) was calculated. 
This supports the conclusion that the variance of the 
residuals is constant. This conclusion is further supported 
by the lack of any noticeable pattern upon visual inspection 
of the residuals in Figures 14-17. 

Similar analysis of the smaller set of 108 residuals 
shows that they also are fairly normal with a sample mean of 
0.004. These residuals are not as symmetric as the larger 
set as evidenced by the higher measure of skewness reported 
in there tat stica! stabl GE Figure 21. While these 
residuals are perhaps not as nearly normal in appearance as 


the larger set, a hypothesis of normally distributed 
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Cena sHyaMH generally supported at the .05 
Sii Icance level by the goodness of fit statistics. In 
this case, the test for heteroskedasticity yielded an 
F-statistic of 1.55 (associated significance level = 0.11) 
which again supports a conclusion of constant variance. In 
this case, however, there appears to be a cyclical pattern 
eche residuals that 15 most apparent in Figure 19. 

The cyclical pattern noted above suggests that a test 
for autocorrelation is in order, In contrast to the larger 
set, a test for autocorrelation in the aggregated residuals 
is meaningful since they are derived from an entirely 
sequential time series. The Durbin-Watson test (see Judge 
SE. al. [Ref. 21]) was used to test for first order 
autocorrelation in the aggregated set of 108 residuals as 
well as in each of the individual job orders. Considering 
the four production cost drivers as the independent 
sariables and, ineluding a constant term (1.e., K = 5), a 
null hypothesis of no autocorrelation was tested against an 
alternative hypothesis of positive autocorrelation. As 
shown in Table II, the Durbin-Watson test statistic was, 
with but two exceptions, less than the lower critical value, 


d ana thus indicative of a positive autocorrelation 


E“ 
problem. Since a nonlinear model was used, transformations 
or the nvo o eliminate this problem are inappropriate 


and the autocorrelation must therefore be included in this 


model. 
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EE EEN 


AUTOCORRELATION TEST RESULTS 


Durbin-Watson Degrees of | dp; dg 
Bata Set ວ 1516 Freedom (5% Significance Level) 
al neb orders 0.3]3 108 025798 2DIDEOx) 
combined 
Job Order 687 07390 34 15208, 16728 
Job Order 692 0.163 30 1. 143,1739 
Job Order 701 0.242 29 eel 24 7743 
Jom Order 713 0652] 22 2556197 
JOD Order 720 0.436 25 J. 0255416767 
oD Order 726 15643 27 0547199750 
Job Order 731 üc 26 IO Z ww 
Job Order 736 0.368 27 1.084,1.753 
Job Order 746 0.944 13 0:57472. 094 
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VI. CONGEDSION 


The objective of the research conducted by Womer and 
Gulledge was to incorporate economic theory into an airframe 
cost estimation model that is estimated from historical data 
and 1S sensitive to exogenous production schedule changes. 
Examination of the Womer-Gulledge model using F-4B cost data 
indicates their approach to be a valid and promising one. 
The results attained with their model are certainly 
comparable to those of other cost estimation models, and, at 
the same time, consistent with economic theory that other 
models have ignored. This conformity with accepted economic 
theory greatly enhances the model's usefulness to Navy 
management vn planning and funding “its aqs erat 
acquisitions. The model has demonstrated a sensitivity to 
production rate changes that should enable a program manager 
to predict the effects of production schedule changes and to 
formulate and implement the most cost effective production 
schedule available. 

Of particular significance in evaluating the model's 
potential applications is the consistency of its parameters 
across quite different airframe production programs. The 


parameter estimates reported in this thesis are quite 
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similar to those attained by Womer and Gulledge in their 
studies oF the C-ZL4179E8102, and F-5/T-38 [Ref. 6]. By 


modifying 8 the scaling parameter, to a level appropriate 


o! 
for the airframe of interest, the model can be adapted to 
plan the time path of resource usage for a new airframe 
before any cost data have been generated for the program. 
As actual production cost data become avallable, the 
preliminary cost estimates can be updated and refined using 
a Bayeslan updating technique described by Womer and 
Culledge PRef. 4861. 

Vhile the model does perform quite vell and has readily 
apparent applications, it is not without flaws. One flaw is 
that the model allows only limited interaction among 
alrframes. By assuming that all airframes in a job order 
are released simultaneously, the model does not allow work 
on an airframe to start later than the lot release date. 
This may create an artificially high production rate and 
understate the effects of learning over time. A second flaw 
NS ENadtwene medel includes no cost penalty for the hiring or 
firing of labor. Therefore, the model may predict that the 
work force should rise, then decline, and then rise again 
when hiring/firing costs may render a more moderate sized 
work force more cost effective during the relatively brief 
peaks and slumps in labor requirements. Another flaw of the 


model is the absence of any mechanism to adjust for the 
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autocorrelation noted in Chapter V. The model should be 
modified to compensate for the temporal relationship in the 
datar 

While not a flaw of the model itself, a potential 
problem in its implementation is data collection. The data 
typically collected is cumulative labor hours per lot of 
alrframes. Without prior planning, it may be difficult to 
acquire the data to estimate the model accurately since the 
model calls for cost information on a per airframe basis. 
In this study, the model was modified slightly with unknown 
effects on accuracy since the data were aggregated on a job 
order level. 

Despite these imperfections, the model should be 
considered a valuable tool for the decisionmaker.  Owing to 
the intricacies and inexactness of the science of cost 
estimation, any and all such tools should be used to improve 
the decisionmaker's awareness of the factors that can 
affect a program's costs. As production scheduling does 
matter as a determinant of program cost, the model may 
enable decisionmakers to better understand the implications 
of funding cuts, stretchouts, and altered delivery schedules 


and, therefore, to make better decisions. 
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Data 


one lime of data entered for each month during which work 


Each line contains 


cusunrəo6 on a jon order. 


TI 


ҹә 


TZ 
labor (in 100,000 hours) 


end oT 


for the job order this month 


where L 


time period 


T2 


Ge air rames delivèredanrior to this 


JOD order 


D 
— - 
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D 
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n work began on this job order 


Ld 


time period whe 


າຈ 
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the last airframe in the job orde 


1 z of 


sequence 


H = average # of airframes in house during this period 


pP 
After these lines, 
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Gut ime Period 


staka 
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the delivery dates for each of the airframes 


tene MOD order are listed. 
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JOB ORDERS 
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